Papers with holistic evaluation approaches
When Personalization Meets Reality: A Multi-Faceted Analysis of Personalized Preference Learning (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Reinforcement Learning from Human Feedback assumes homogeneous preferences across users . personalization can introduce up to 20% safety misalignment . |
| Approach: | They propose a framework to assess personalized preference learning by tailoring preferences for users . they compare eight personalization methods across three preference datasets . |
| Outcome: | The proposed framework measures performance, fairness, unintended effects, adaptability across preferences . performance differences between personalization methods could reach 36% when users strongly disagree . |